Validity of Self-testing at Home With Rapid Severe Acute Respiratory Syndrome Coronavirus 2 Antibody Detection by Lateral Flow Immunoassay.

BACKGROUND: We explore severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) antibody lateral flow immunoassay (LFIA) performance under field conditions compared to laboratory-based electrochemiluminescence immunoassay (ECLIA) and live virus neutralization. METHODS: In July 2021, 3758 participants performed, at home, a self-administered Fortress LFIA on finger-prick blood, reported and submitted a photograph of the result, and provided a self-collected capillary blood sample for assessment of immunoglobulin G (IgG) antibodies using the Roche Elecsys® Anti-SARS-CoV-2 ECLIA. We compared the self-reported LFIA result to the quantitative ECLIA and checked the reading of the LFIA result with an automated image analysis (ALFA). In a subsample of 250 participants, we compared the results to live virus neutralization. RESULTS: Almost all participants (3593/3758, 95.6%) had been vaccinated or reported prior infection. Overall, 2777/3758 (73.9%) were positive on self-reported LFIA, 2811/3457 (81.3%) positive by LFIA when ALFA-reported, and 3622/3758 (96.4%) positive on ECLIA (using the manufacturer reference standard threshold for positivity of 0.8 U mL-1). Live virus neutralization was detected in 169 of 250 randomly selected samples (67.6%); 133/169 were positive with self-reported LFIA (sensitivity 78.7%; 95% confidence interval [CI]: 71.8, 84.6), 142/155 (91.6%; 95% CI: 86.1, 95.5) with ALFA, and 169 (100%; 95% CI: 97.8, 100.0) with ECLIA. There were 81 samples with no detectable virus neutralization; 47/81 were negative with self-reported LFIA (specificity 58.0%; 95% CI: 46.5, 68.9), 34/75 (45.3%; 95% CI: 33.8, 57.3) with ALFA, and 0/81 (0%; 95% CI: 0, 4.5) with ECLIA. CONCLUSIONS: Self-administered LFIA is less sensitive than a quantitative antibody test, but the positivity in LFIA correlates better than the quantitative ECLIA with virus neutralization.

Machine learning to support visual auditing of home-based lateral flow immunoassay self-test results for SARS-CoV-2 antibodies.

Background: Lateral flow immunoassays (LFIAs) are being used worldwide for COVID-19 mass testing and antibody prevalence studies. Relatively simple to use and low cost, these tests can be self-administered at home, but rely on subjective interpretation of a test line by eye, risking false positives and false negatives. Here, we report on the development of ALFA (Automated Lateral Flow Analysis) to improve reported sensitivity and specificity. Methods: Our computational pipeline uses machine learning, computer vision techniques and signal processing algorithms to analyse images of the Fortress LFIA SARS-CoV-2 antibody self-test, and subsequently classify results as invalid, IgG negative and IgG positive. A large image library of 595,339 participant-submitted test photographs was created as part of the REACT-2 community SARS-CoV-2 antibody prevalence study in England, UK. Alongside ALFA, we developed an analysis toolkit which could also detect device blood leakage issues. Results: Automated analysis showed substantial agreement with human experts (Cohen's kappa 0.90-0.97) and performed consistently better than study participants, particularly for weak positive IgG results. Specificity (98.7-99.4%) and sensitivity (90.1-97.1%) were high compared with visual interpretation by human experts (ranges due to the varying prevalence of weak positive IgG tests in datasets). Conclusions: Given the potential for LFIAs to be used at scale in the COVID-19 response (for both antibody and antigen testing), even a small improvement in the accuracy of the algorithms could impact the lives of millions of people by reducing the risk of false-positive and false-negative result read-outs by members of the public. Our findings support the use of machine learning-enabled automated reading of at-home antibody lateral flow tests as a tool for improved accuracy for population-level community surveillance.